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@ Frequency transposing hearing aid. 

@ Hearing aid apparatus comprising: 

apparatus for converting audio frequency sounds to electrical 

input signals; 

apparatus (11, 12) for storage of an information waveform 
associated with the electrical input signals; 
apparatus (14, 26, 84) for controlling the storage means to 
operate at an information storage rate, the controlling appara- 
tus (14, 26, 84) operating the storage means to retrieve the 
stored information waveform at an Information retrieval rate, the 
apparatus for controlling (14, 26, 84) including frequency 
analyzer apparatus (26) for classifying incoming audio fre- 
quency sounds as to their frequency and apparatus responsive 
to predetermined patient hearing characteristics for determin- 
ing the relationship between the information storage rate and 
the information retrieval rate for the Incoming audio frequency 
sounds; 

apparatus for reproducing audio frequency sounds based on 
the stored Information waveform in accordance with the 
information retrieval rate, wherein the reproduced audio 
frequency sounds are transposed to a frequency determined by 
the relationship between the information storage and retrieval 
rates. 
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Description 

FREQUENCY 



FIELD OF THE INVENTION 5 

The present invention relates to hearing aid 
devices, and more particularly, to an improved 
hearing aid incorporating a frequency transposing 
operation enabling a user whose hearing capability 10 
is limited to a narrow frequency band to hear 
information contained in a wide range of audio 
frequencies. 

15 

BACKGROUND OF THE INVENTION 

There are known hearing aid circuits which 
provide frequency shifting of analog signals in a real 
time manner for reducing the frequency of such 20 
signals for a person having limited frequency 
audibility. Examples of such circuits are found in U.S. 
Patent 4,271,331 to Kalkstein, 4,366,349 to Adelman 
and 4,419,544 to Adelman. Typically the frequency 
shifting is produced by using a multi-element 25 
storage component such as a conventional serial 
analog delay element. The signal moves through 
each serial memory in a "bucket brigade" fashion in 
response to clock pulses. The timing of the clock 
pulses is varied in order to achieve desired delays 30 
and frequency shifts. 

The above technique has a significant disadvant- 
age. Due to the fact that frequency reduction Is 
produced by setting the clocking-out rate from the 
delay element to be slower than the clocking-in rate 35 
thereto, there is necessarily a loss of information 
which is related to the amount of frequency 
reduction. This loss of information arises due to the 
fact that more information Is being supplied to the 
delay element than is being read out therefrom. 40 



SUMMARY OF THE INVENTION 

Accordingly, it is a principal object of the present 45 
invention to overcome the above-mentioned disad- 
vantage and provide a hearing aid featuring a 
frequency transposition function which changes the 
audio frequencies contained within Input speech 
components and enables a user to hear information 50 
contained therein within a frequency band associ- 
ated with hearing capability, while maintaining ac- 
ceptable speech intelligibility. 

In accordance with a preferred embodiment of the 
present invention, there is provided hearing aid 55 
apparatus comprising: 

apparatus for converting audio frequency sounds to 
electrical input signals; 

apparatus for storage of an information waveform 
associated with the electrical input signals; 60 
apparatus for controlling the storage means to 
operate at an information storage rate, the controll- 
ing apparatus operating the storage means to 



NG HEARING AID 

retrieve the stored information waveform at an 
information retrieval rate, the apparatus for controll- 
ing including frequency analyzer apparatus for 
classifying incoming audio frequency sounds as to 
their frequency and apparatus responsive to pre- 
determined patient hearing characteristics for deter- 
mining the relationship between the information 
storage rate and the information retrieval rate for the 
incoming audio frequency sounds; 
apparatus for reproducing audio frequency sounds 
based on the stored information waveform in 
accordance with the information retrieval rate, 
wherein the reproduced audio frequency sounds are 
transposed to a frequency determined by the 
relationship between the information storage and 
retrieval rates. 

In a preferred embodiment, the hearing aid 
incorporates electronic circuitry integrated in a 
hearing aid or transmitting thereto, which changes 
the audio frequencies contained within input speech 
components (or phonemes) of a speech pattern 
represented by an input information waveform by 
using different clocking rates for information storage 
and retrieval. The information storage and retrieval 
clocking rates are applied to govern the operation of 
a pair of storage devices. 

For example, a pair of analog delay lines can be 
configured in a switched push-pull arrangement, 
whereby one delay line stores input information at 
one clock rate while information is retrieved at the 
output of the second one at a different rate. The 
same effect can be achieved by a pair of memory 
devices which receive information at a clocking-ln 
rate from respective A/D converters and feed it to 
respective D/A converters at a clocking-out rate 
which is different. The basic operation is termed 
"frequency transposition". 

If the clocking-out rate is slower than the 
clocking-in rate by a predetermined ratio, frequency 
transposition results in reduction of the frequency 
and effectively allows the user to hear the higher 
frequencies contained within speech components in 
a lower audio frequency range. The predetermined 
ratio is termed herein as the "transposition coeffi- 
cient." 

In accordance with a preferred embodiment of the 
invention apparatus is provided for recirculating 
information originally stored in the storage means 
back to the storage means. 

In this way speech components containing the 
same frequency spectrum as information "lost" in 
prior art embodiments is preserved in the output 
signal. 

The system also provides the capability of raising 
the frequencies contained within input speech 
components by using an output clock rate faster 
than that used on the input. This would allow a user 
having "middle" range hearing capability to hear low 
frequencies contained within input speech compo- 
nents in a higher frequency range. 

In another alternative embodiment, the disadvant- 
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age of lost Information is overcome by a reconstruc- 
tion method wherein portions of the input speech 
components are stored based on the pattern of their 
frequency spectra. The storage device is controlled 
such that it operates based on recognition of the 5 
time interval between changes in the input frequency 
spectrum as detected by the frequency analyzer. 
The clocking-ln operation is carried out for only a 
portion of this interval relative to the size of the 
transposition coefficient w 

During the remaining portion of the time interval 
the clocking-in operation ceases until a new input 
frequency change Is detected. Thus, only a portion 
of the information enters the storage device, and this 
portion contains a group of signal frequency compo- 15 
nents taken from the input speech which preserve 
the pattern of frequency spectra for Information 
retrieval purposes. 

In accordance with a preferred embodiment of the 
invention, there is provided approximator apparatus 20 
which Is operative to combine the information 
waveform from the pair of storage devices at the 
time of switching in order to smooth the output 
waveform. 

The system provides practical elimination of 25 
unwanted acoustic feedback to the user for high 
frequency signals. When such signals are detected 
by the frequency analyzer, the frequency transposi- 
tion operation is maintained for an additional fixed 
interval beyond the duration of the input signal itself, 30 
thereby reducing the input signal to a lower 
frequency and preventing reamplification of any 
stray "echoes" so that the signal does not "feed" on 
itself. 

Additionally in order to avoid unwanted acoustic 35 
feedback, a noise generator may be provided to 
constantly vary by a small amount the relationship 
between the clocking in rate and the clocking out 
rate. 

In the preferred embodiment, the inventive hear- 40 
ing aid is designed to be worn as a device useful for 
ordinary conversation. 

Other features and advantages of the invention 
will become apparent from the drawings and the 
description contained hereinbelow. 45 



BRIEF DESCRIPTION OF THE DRAWINGS 

For a better understanding of the invention, 50 
reference is made to the accompanying drawings, in 
which like numerals refer to corresponding elements 
or sections throughout, and in which: 

Fig. 1 Is a schematic block diagram of a part 
of prior art hearing aid apparatus ; 55 

Fig. 2A shows an input information waveform 
having amplitude and frequency characteristics 
associated with sounds provided as input to the 
prior art apparatus of Fig. 1 ; 

Figs. 2B and 2C show the amplitude and 60 
frequency characteristics associated with out- 
put signals produced by the prior art apparatus 
of Fig. 1 through frequency transposition of the 
input information waveform of Fig. 2A; 
Fig. 3 shows a schematic block diagram of a 65 



hearing aid constructed and operative in ac- 
cordance with a preferred embodiment of the 
invention; 

Fig. 4A shows an input information waveform 
having amplitude and frequency characteristics 
associated with sounds provided as input to the 
hearing aid of Fig. 3; 

Fig. 4B shows the amplitude and frequency 
characteristics of the information waveform 
associated with storage of the input waveform 
of Fig. 4 A. 

Fig. 4C shows the amplitude and frequency 
characteristics associated with output signal 
produced by the hearing aid of Fig. 3 through 
frequency transposition of the stored informa- 
tion waveform of Fig. 4B; 

Fig. 5 is a detailed schematic illustration of 
the hearing aid of Fig. 3; 

Fig. 6 is a schematic block diagram of a 
hearing aid constructed and operative in ac- 
cordance with an alternative embodiment of the 
Invention; 

Fig. 7 is a schematic block diagram of a 
hearing aid constructed and operative in ac- 
cordance with a further alternative embodiment 
of the invention; 

Figs. 8A - 8G are multi-frequency input infor- 
mation waveform and timing diagrams associ- 
ated with embodiment of Fig. 7; 

Fig. 9 is a schematic block diagram of a 
controller portion of the embodiment of Fig. 7; 

Fig. 10 Is a schematic illustration of a 
frequency analyzer forming part of the circuitry 
of the embodiment of Fig. 7; 

Figs. 11A-11G are timing diagrams of the 
operation of the alternative controller embodi- 
ment of Fig. 9; and 

Fig. 12 shows a flowchart of an algorithm 
controlling the operation of a microcontroller 
operative in accordance with the timing diag- 
rams of Fig. 11 A -11 G. 

DETAILED DESCRIPTION OF A PREFERRED 
EMBODIMENT 

In order to understand and appreciate the present 
Invention it is necessary to understand the operation 
of prior art apparatus and its limitations. 

Referring now to Fig. 1, there is shown a block 
diagram of a prior art hearing aid such as that 
described In connection with Fig. 1 of above-men- 
tioned U.S. Patent 4,271,331 . The basic design of the 
prior art device is a switched push-pull arrangement 
comprising a pair of analog delay lines 11 and 12 
each of which has an input stage to which there is 
fed an input signal 13 containing audio frequency 
information based on a speech pattern provided by a 
microphone (not shown). A clock generator 14 
controls the operation of delay lines 11 and 12 via 
respective clock lines 15 and 16 by determining the 
clocking-in rate with which the information in input 
signal 13 is stored. 

The stored Information is retrieved from the 
output stage of respective delay lines 11 and 12 at a 



3 



5 



EP 0329 383 A2 



6 



clocking-out rate also determined by respective 
clock fines 15 and 16. During this operation, a 
respective one of a pair of switches 17 and 18, also 
controlled by clock generator 14, is closed via 
respective enable lines 19 and 20, to permit the 
clocking-out of stored information. An amplifier 22 
provides an amplified output signal 24. 

By virtue of the above-described switched push- 
pull arrangement, the operation of delay lines 1 1 and 
12 is controlled on an alternate basis in storage and 
retrieval modes. That is, while delay line 11, for 
example, is operated via clock line 15 to store 
current information, delay line 12 is simultaneously 
operated via clock line 16 and enable line 20 to 
retrieve the previously stored information waveform 
through switch 18. The operation is then reversed 
and repeated with respect to delay lines 11 and 12. 

If. for example, the clocking-out rate is half that of 
the clocking-in rate, effectively, audio input signal 13 
has its frequency range reduced by one-half in 
formation of output signal 24, since the clocking rate 
on the output is slower than that on the input by a 
factor of two. As referred to herein this technique is 
termed "frequency transposition" , and for the 
example given, the clocking-in/clocking-out rate 
ratio, herein termed the "transposition coefficient z", 
is given by the relation z=2. 

An illustration of the frequency transposition 
technique is shown in Figs. 2A-C. In Fig. 2A, input 
signal 13 provides an information waveform 29 
having signal characteristics relating to its amplitude 
(A) and frequency (f). per characteristic curve 30. 
The signal frequency component f in waveform 29 
establishes the frequency range of the audio input 
information. The period of waveform 29 is shown as 
twice the time interval t0-t1 (2t1), and two complete 
cycles of waveform 29 occur in the interval t0-t4. 

The push-pull switching operation of delay lines 1 1 
and 12 is periodic and is defined as occurring within 
a periodic interval, here defined as being between 
t0-t4. That is, storage or retrieval of information 
waveform 29 occurs within this periodic interval 
during which delay line 1 1 is operated in the storage 
mode, while delay line 12 is operated in the retrieval 
mode. At the end of the periodic interval t0-t4, the 
operation reverses with respect to delay lines 1 1 and 
12, such that the former operates in the retrieval 
mode (interval t4-t8) while the latter operates in the 
storage mode. 

Thus, at the instant of time denoted as to, 
waveform 29 is presented to delay line 1 1 for storage 
purposes. In the following exemplary discussion, the 
frequency component of interest is indicated as f 
and has a frequency of 1000Hz. Based on the 
storage capacity of the delay lines 11 and 12, the 
periodic interval is a function of the clocking-out rate 
established by the adaptation coefficient. This is 
given by the relationship: 
# of storage cells / clocking-out rate = periodic 
interval (1) 

which yields a periodic interval of 12.8 msec for a 512 
storage cell delay line 11 or 12, using a clocking-out 
rate of 40 kHz. 

If. in this example, the adaptation coefficient is 
z = 2. the clocking-out rate will be slower than the 



clocking-in rate by a factor of 2. 

Therefore, for z = 2, 
# of storage ceils / clocking-in rate = periodic 
Interval/2 (2) 
5 Accordingly, only the last 50% of the periodic 
interval t0-t4 is utilized for storage. Thus, the portion 
32 (Interval t0-t2) of input information waveform 29 is 
lost at the output stage of delay line 1 1 . However, the 
portion 34 (interval t2-t4) of waveform 29 remains 

10 stored in delay line 1 1 , until the next periodic interval 
during which it will be retrieved. 

In Fig. 2B, stored waveform portion 34 is shown as 
it is retrieved from delay line 11. This occurs when 
the push-pull switching operation determines that 

75 delay line 11 operates in the retrieval mode, which 
commences at time t4. The time interval between the 
beginning of waveform portion 34 (t2) and the time 
the retrieval operation commences (t4) is defined as 
the delay Interval D1, which is introduced by delay 

20 line 11. 

When delay line 11 commences operation in the 
retrieval mode at time instant t4 with respect to 
waveform 29 In Fig. 2a, clock generator 14 governs 
the clocking-out rate via clock line 15 and enable line 

25 1 9 to output stage switch 1 7. Since the transposition 
coefficient is z=2, the clocking-out rate used during 
the retrieval operation is half that of the clocking-in 
rate, resulting in a "stretching 11 of waveform portion 
34. This result produces a reduction in signal 

30 frequency component f to f/2=500 Hz, per charac- 
teristic curve 38. The "stretching" effect utilizes 
100% of the periodic interval t4-t8 during which 
delay line 11 operates in the retrieval mode. Thus, 
the output audio signal 24 produced by the 

35 "stretched" waveform 34 of Fig. 2B is heard by the 
user in a lower audio frequency range. 

Fig. 2C illustrates the frequency adaptation tech- 
nique for the case where the adaptation coefficient is 
given by the relation z = 4, in which case delay line 1 1 

40 provides a delay interval D2. Here, only waveform 
portion 36 (negative lobe during interval t3-t4) has 
been stored by delay line 11 before the retrieval 
mode commences. 
In this example, only 25% of the periodic interval 

45 t0-t4 is utilized for storage. Since the clocking-out 
rate in this case is slower than the clocking-in rate by 
a factor of 4, signal frequency component f of 
information waveform 29 is reduced to f/4=250 Hz, 
per characteristic curve 40. Again, the "stretching" 

50 effect is present with 1 00% utilization of the periodic 
interval in the retrieval mode. 

As stated previously, in the case where the 
transposition coefficient is described by the relation 
z=2, one-half of information waveform 29 is lost, 

55 since waveform portion 32 (interval t0-t2) Is not 
stored by delay line 1 1 . The result is that only 500/o of 
the periodic Interval is utilized during storage. This is 
because only the last portion of the new information 
remains stored in one of delay lines 11 or 12 when 

60 the current information has been completely re- 
trieved from the other one. In the case of the 
transposition coefficient described by the relation 
z=4, because there is only 25<Vo utilization of the 
periodic interval during storage, 75% of the informa- 

65 tion is lost. 
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In practical terms, the consequence of the 
Information loss resulting from use of transposition 
coefficients greater than 1 couid be critical to 
speech intelligibility where the speech contains 
short duration phonemes such as consonants. Such 
consonants may be lost on a random basis because 
the push-pull switching operation between delay 
lines 11 and 12 is not synchronized to frequency 
changes In the speech waveforms. 

In Fig. 3, a schematic block diagram of a preferred 
embodiment of hearing aid is shown which incorpor- 
ates a technique for diminishing the adverse effect 
of information loss due to frequency transposition. 
This technique involves recovery of information by 
recirculation of the output of each of delay lines 11 
and 12 back to its respective input stage. 

As shown in Fig. 3, audio input signal 13 is 
provided via amplifier 70 to the respective input 
stage 72 and 74 of each of delay lines 11 and 12, as 
wefi as to frequency analyzer 26. 

Frequency analyzer 26 determines the input and 
output clocking rates at which delay lines 11 and 12 
are operated. Generally, although the inventive 
hearing aid Is capable of dividing the audio fre- 
quency spectrum into various ranges by design of 
frequency analyzer 26, it is not recommended to 
divide the spectrum into more than two ranges In 
order to avoid confusion by the user. The frequency 
spectrum is usually divided into two ranges, one 
from 0-2500 Hz corresponding to voiced phonemes 
(vowels), and one from 2500-8000 Hz corresponding 
to non-voiced phonemes (consonants). Frequency 
analyzer 26 determines in which frequency range the 
weighted average of amplitude of the information 
waveform lies so as to Instruct clock generator 14 to 
apply the appropriate transposition coefficient. 

In accordance with the recovery or recirculation 
technique applied in the embodiment of Fig. 3, a pair 
of recirculation switches 80 and 82 are provided 
connecting the output of delay lines 11 and 12 with 
their respective input stages 72 and 74. Input stages 
72 and 74 include respective switches 76 and 78 for 
coordinating the recirculation technique with the 
input of new information waveforms. The enabling 
signals 19 and 20, control recirculation switches 76, 
78, 80 and 62 operation through clock generator 14. 

During the time interval in which there is no 
clocking-out operation on a given one of delay lines 
1 1 or 12, the respective one of output stage switches 
17 and 18 is open. At this point, the associated one 
of recirculation switches 80 and 82 together with its 
counterpart input stage switch 76 or 78 are closed 
by clock generator 14 to achieve recirculation. 
During the time interval in which clocking-out occurs 
via one of clock lines 15 or 16 such that information 
is retrieved through the' closed one of output stage 
switches 17 or 18, the appropriate one of input stage 
switches 76 and 78 is open to prevent the Input of 
new Information waveforms. 

The result Is recirculation of the stored informa- 
tion in the delay line through its input stage, such 
that a summation of old and new information 
waveforms is provided to the user. This has the 
effect of smoothing the speech sound such that the 
user is able better to understand the sound created 



by the waveform combination. 

For example, in the case of a word containing 
consonants such as a plural °s", high signal 
frequency components are present for only a short 
5 duration. As this sound is highly important to speech 
Intelligibility, the recovery technique prevents the 
possibility of its loss due to frequency transposition. 
By recirculating this signal frequency component of 
the information waveform through the delay line via 
10 switches 80 and 82, components of the frequency 
spectrum related to this phoneme are preserved in 
the output signal. 

An illustration of the recirculation technique is 
shown in Fig. 4A-C. In Fig. 4A input signal 13 
15 provides an information waveform having two fre- 
quency components f1 and f2. The time interval 
t0-t2. in Fig. 4A, Is equivalent to the periodic interval. 
Fig. 4B shows recirculation of frequency component 
f1 from the output stage of delay line 11 back to Its 
20 respective input stage during storage mode. The 
resulting waveform is a summation of frequency 
components f1 and f2. The summation of old 
information f1 and new information f2 Is preserved 
and stored In delay line 11 at the end of the periodic 
25 interval, in Fig. 4C the stored information waveform 
(a summation of frequency components f 1 and f2) Is 
shown as it Is retrieved from delay line 11 during 
retrieval mode. 
Referring now to Fig. 5, there is shown an 
30 electronic circuit schematic of the preferred em- 
bodiment of Fig. 3. As shown, the inventive hearing 
aid is designed and constructed in accordance with 
skill of the art electronic design techniques using 
CMOS Series 4000 integrated circuits (IC). Typical 
35 components used In this design for delay lines 11 
and 12 are provided by Reticon IC type RD 5107, with 
output stage analog switches 17, 18, 76, 78, 80 and 
82, provided by IC type 4066. 
Amplifiers 79 and 81 are typically type LM324 and 
40 provide to respective delay lines 11 and 12 a 
summation of new information received from input 
13 via respective switches 76 and 78 and recircu- 
lated information received via respective switches 80 
and 82. 

45 Audio input signal 13 is provided to delay lines 1 1 
and 12 and to frequency analyzer 26, the latter 
comprising voltage comparators provided by cir- 
cuits 42, 44 and 46, such as IC type ML 324. 
Clock generator 14 is comprised of a combination 

50 of integrated circuits 48, 49, 50 and 52, circuits 48 
and 49 typically being embodied in IC type 555, 
integrated circuit 50 typically being embodied in IC 
type ML 4040 and integrated circuit 52 typically being 
embodied in IC type 4066. The operation of clock 

55 generator 14 is based on the frequency determina- 
tion signal 27 provided as an output by frequency 
analyzer 26. 

Approximator 23 provides a smoothing compara- 
tor 56 for attenuating spikes caused by existing 

60 voltage differentials between the output levels of 
delay lines 11 and 12. This is accomplished by 
comparison of the voltage levels between them at 
points 58 and 60 and timing the operation of switch 
62 to allow switching between them to occur only 

65 when the levels are matched. 
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Output signal 24 is provided as a driving signal to a 
power amplifier in a final stage (not shown) of 
hearing aid 10. after which it is converted to audio 
sounds by a suitable transducer. 

Reference is now made to Fig. 6, which illustrates 
an alternative embodiment of hearing aid which is 
similar to that described and shown in connection 
with Fig. 3 but wherein the frequency transposition is 
from lower frequencies to higher frequencies in 
order to accommodate patients having middle range 
hearing capability. 

The circuitry of Fig. 6 is identical to that of Fig. 3 
except as specifically noted hereinbelow. Identical 
reference numerals are employed to denote identical 
elements for the sake of clarity. In contrast to the 
embodiment of Fig. 3, the relationship between the 
clocking rates at which delay lines 11 and 12 operate 
is reversed, that is the clocking-in rate is lower than 
the clocking out rate. The transposition coefficient is 
smaller than one (z < 1). 

It may be appreciated that in this embodiment, it is 
necessary to provide recirculation of information 
through the delay lines in order to prevent an 
intermittent audio output from being presented to 
the patient. Accordingly, the following structural 
changes to the circuit of Fig. 3 appear in the circuit of 
Fig. 6. Whereas enable signal 19 was originally 
supplied to switch 82, it is no longer supplied thereto 
but is now instead supplied to switch 80. Whereas 
enable signal 20 formerly was supplied to switch 80, 
it is no longer supplied to switch 80 but is instead 
supplied to switch 82. 

In terms of operation, the circuitry of Fig. 6 Is 
identical to that of Fig. 3, except that the clocking in 
and clocking out rates are reversed and the 
recirculated speech component is repeated so as to 
fill in the gaps between clocked out information. 

Referring now to Fig. 7, there is shown a 
schematic block diagram of another alternative 
embodiment of the hearing aid of the present 
invention wherein a reconstruction method is ap- 
plied to a multi-frequency information waveform to 
avoid information loss due to frequency transposi- 
tion. In this approach, multiple signal frequency 
components 'in audio Input signal 13 are treated 
individually with regard to frequency transposition so 
as to provide output signal 24 with a portion of the 
information relating to each of them, thereby 
preserving the pattern of the frequency spectrum. 
The operation occurs in two stages for a given 
information waveform: advance computation of the 
necessary parameters of frequency adaptation fol- 
lowed by performance of control functions related to 
the frequency transposition technique itself. 

As shown, the basic schematic block diagram of 
Fig. 1 has been modified to include components 
such as a controller 84 and additional delay lines 
85a-b. Control signals 86 and 87, characteristic 
signal 88 and clock signal 89 determine controller 84 
operation, and controller 84 in turn provides control 
signals 91 and 92 to clock generator 14, as well as to 
analyzer 26 and approximator 23. 

In general terms of operation, delay line 85a 
introduces an additional delay time interval, equival- 
ent to the push-pull periodic interval, to audio input 



signal 13. In this delay time interval, frequency 
analyzer 26 provides control signal 87 in relation to 
the occurrence of a change of a given size in the 
frequency of audio input signal 13. In response to 
5 frequency determination signal 27, controller 84 
reads the external mode selector 28 and obtains the 
value of z on characteristic signal 88. When control 
signal 87 is received, controller 84 computes, in 
relation to z, the necessary time intervals for 

10 operation of clock generator 14 with respect to the 
clocking-in rates supplied on clock lines 15 and 16. 
The operation of clock lines 15 and 16 is enabled 
within clock generator 14 by respective internal 
switches 94 and 96. 

15 Based on these computations, controller 84 
performs control functions relating to frequency 
transposition in a constant timing sequence estab- 
lished by control signal 86. The frequency transposi- 
tion coefficient z applied by clock generator 14 In 

20 delay lines 1 1 and 12 per these computations is then 
appropriately adjusted by frequency determination 
signal 27' after the time delay introduced in Its 
counterpart signal 27 by delay line 85b. The 
adjustment of the transposition coefficient for the 

25 new signal frequency is determined in controller 84 
by frequency determination signal 27 together with 
characteristic signal 88 containing the value z, so 
that the necessary portion of the associated infor- 
mation waveform is stored and retrieved. 

30 Turning now to Figs. 8A - 8G, there is shown a 
multi-frequency Input Information waveform 100 to 
which the reconstruction method is applied in the 
alternative embodiment of Fig. 7. Input waveform 100 
in Fig. 8A Is provided as audio input signal 13 and 

35 comprises portions i, j and k, containing high, low 
. and intermediate signal frequencies, respectively, fi, 
fj and fk. As shown, portion I of waveform 100 may 
have a pre-existing portion at the same signal 
frequency (not shown). In Fig. 8B, segments of the 

40 respective input information waveform portions 
100i-k corresponding to intervals i/z, j/z and k/z are 
stored for each of the signal frequency components 
fi, fj and fk appearing therein. 
Fig. 8C shows the timing sequence established by 

45 control signal 86. Fig. 8D shows the timing of control 
signal 87, at which point each of the new frequencies 
fj and fk are first detected. The combination of 
control signals 86 and 87 eliminate the problems 
arising from the asynchronous nature of the 

50 changes in waveforms 13 with respect to the 
push-pull switching operation of delay lines 1 1 and 
12. That is, even though the changes in the signal 
frequency components are random (control signal 
87), the timing sequence is fixed by the occurrence 

55 of control signal 86. 

In this embodiment, the periodic interval T 
extends for the duration of the individual signal 
frequency components and is defined as the sum of 
the intervals in which they occur, namely 

60 T = Ti1 + Ti2 + Tj1 + Tj2 + Tk1 + Tk2 (3) 

In order that output audio signal 24 contain rep- 
resentative signal frequency components present in 
waveform portions 100i-k, the segments of these 
waveform portions occurring during intervals Ti1 , Tj1 

65 and Tk1 must be stored during the clocking-in 
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operation of delay lines 11 and 12, as shown In 
Fig. 8E. However, the T12 ( Tj2 and Tk2 segments of 
these information waveform portions will not be 
stored because clocking-in ceases during these 
intervals. 

For a periodic interval T divided into 256 timing 
units Tu, and a known range of clocking-in and 
clocking-out rates between 10 and 40 kHz, a 
relationship can be developed for the timing of the 
waveform 100i-k. Since the periodic intervai T is 
equivalent to the sum of the intervals containing 
portions i, J and k, it is true that 
256 *Tu = l + j + k = T (4) 
The frequency of the clocking-in and clocking-out 
rates is related to the inverse of the periodic interval 
T, so that for the range of clock rates between 
10-40 kHz, the periodic interval can be expressed 
as: 

( 1/10 kHz ) £ Tu £ ( 1/40 kHz ) (5) 

or 0.1 msec £ Tu £ 25 usee (6) 

Thus, the duration of the periodic interval T can be 

expressed as 

( 256 * 0.1 msep ) > T > ( 256 * 25 usee ) (7) 
or 25.6 msec £ T £ 6.4 msec (8) 

Since in the illustrated example of Figs. 8A - 8G, 
the transposition coefficient applied to each individ- 
ual frequency Is the same (as given by the relation 
z=2) the periodic interval utilization for storage will 
be 50o/o as with Figs. 2A - 2B. Thus, in Fig. 8F the 
stored segments Ti1, Tj1 and Tk1 of respective 
waveforms 100i-k are shown, each being one-half 
the duration of the original waveform. When fre- 
quency transposition with this coefficient Is per- 
formed on the stored segments, the result is a 
reduction in frequency as shown in Fig. 8G, wherein 
each of the waveforms is "stretched 0 to utilize 100% 
of the periodic interval T defined by the timing 
sequence. 

In operation of the alternative embodiment of 
Fig. 7, control signal 86 provides controller 84 with 
the timing sequence of the push-pull switching 
operation in the case of the multi-frequency informa- 
tion waveform 100i-k. The timing sequence estab- 
lished by control signal 86 is equivalent to the 
periodic intervai defined in equation (3). For each 
frequency component contained within the speech 
signal, frequency analyzer 26 provides control signal 
87 and frequency determination signal 27 to control- 
ler 84, which computes the proper duration of the 
clocking-in intervai as a function of the transposition 
coefficient z provided by characteristic signal 88. 
The result of the computation is provided by control 
signals 91 and 92 to clock generator 14, enabling 
clock lines 15 and 16 via respective internal switches 
94 and 96. The entire control procedure is now 
described with reference to Figs. 8A-8G and 9, 
which respectively show a timing diagram and a 
schematic block diagram of controller 84. 

Controller 84 comprises a distributor 102, a set of 
counters 104-112, divider 113, comparators 114, 
116, high frequency clock generator 117, a pair of 
shift registers 118, 120 and a serial input/parallel 
output buffer 122. Distributor 102, which may be an 
IC type 4017, interfaces with external control signal 
86 for determining the start of the timing sequence. 



Counters 104 and 106, both IC types 4040, are 
provided to determine the elapsed time interval 
between different signal frequency components in 
audio input signal 13 as indicated by control signal 
5 87. This is achieved by providing counter 104 with 
clock signal 89 at a fixed clock frequency fc, while 
counter 106 is provided with clock frequency fc/z 
from divider 113 after division by the transposition 
coefficient 'z n , introduced by characteristic signal 88 
10 in response to frequency determination signal.27. 

When frequency analyzer 26 detects the given 
size change in the frequency .spectrum of the audio 
input signal 13 signifying the end of waveform 
portion 1001 and the beginning of waveform portion 
15 1 00j, it provides a voltage spike to distributor 102 via 
control signal 87. Corresponding control signals 124 
and 126 from distributor 102 are sent to counters 
104 and 106 to stop their operation. At this point, 
counter 104 contains the parameter T (Fig. 8A), 

20 which is the elapsed time interval for the frequency 
component "fi" of the 1001 waveform portion in the 
audio Input signal 13. Similarly, counter 106 then 
contains the parameter "i/z" (Fig. 8B), which is the 
time interval needed to establish the segment TI1 of 

25 waveform 100i which is to be stored. 

Distributor 102 then provides control signals 124 
and 126 with instructions by which counter 104 
writes its count, parameter in comparator 1 14, which 
may be a combination of IC types 4516 + 4078, while 

30 counter 106 writes its count, parameter "i/z°, in 
counter 108, an IC type 4516. A high frequency clock 
generator 117, IC type 555, is then operated by 
distributor 102 so as to cause counters 108 and 110 
to count up. Since counter 108 now begins counting 

35 up from parameter "i/z", it matches parameter T 
stored in comparator 114 when it has counted a 
parameter equivalent to the difference between 
parameters T and "i/z", expressed as (i-i/z). At this 
point, counter 110, an IC type 4040, contains this 

40 difference, which is the time interval needed to 
establish the segment Ti2 of the respective wave- 
form 100i which will not be stored. 

When comparator 114 signals distributor 102 via 
control signal 128 that difference parameter "i-i/z" 

45 has been determined, the parameters "i/z" and 
"i-i/z" respectively stored in counters 106 and 110 
are transferred to one of shift registers 1 1 8 or 1 20, a 
pair of IC types 4517. Shift registers 118 and 120 are 
respectively associated with delay lines 11 and 12 

50. and operate in storage and discharge modes to 
control the delay line clocking operation. This is 
done by applying the parameters which they have 
accumulated to control the operation of clock 
generator 14 via switches 94 and 96, which are 

55 toggle switches (IC type 4066) enabling respective 
clock lines 15 and 16. 

When one of shift registers 118 and 120 accumu- 
lates its parameters for the segments Ti1, Ti2, Tj1, 
Tj2, Tk1 and Tk2 occurring in one periodic interval T 

60 (Fig. 8A). the other one is being discharged with 
similar parameters for a multi-frequency waveform 
occurring previous to waveform 100. The operation 
of shift registers 118 and 120 complements the 
switched push-pull delay line operation, so that 

65 when one shift register discharges, its associated 
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delay line 11 or 12 stores information during a 
clocking-in interval. 

Thus, once the parameters °i/z° and "W/z" are 
accumulated in shift register 118, for example, 
control signal 87 causes distributor 102 to repeat the 
operation of counters 102-110 for the J and k 
portions of waveform 100, so that all of the 
parameters are accumulated in shift register 118. 
Control signal 86 now indicates the end of the 
periodic interval (Fig. 8C). At this point, control 
signal 124 indicates that the first accumulated 
parameter In shift register 118, segment Ti1 (i/z), is 
to be transferred serially to buffer 122, an I C type 
4094, and the parallel output thereof writes this 
parameter in comparator 1 16, an IC type 4078. At the 
same instant, control signal 91 provides switch 94 
with a toggle operation so that it enables clock line 
15 of clock generator 14. 

Distributor 102 now operates counter 112, an IC 
type 4040, via control signal 130 so that it counts at 
clock frequency fc per clock signal 89. Comparator 
116 compares the count of counter 112 with that of 
parameter "i/z". -Once comparator 116 has estab- 
lished the timing sequence governing the operation 
of clock generator 14 for segment Tii of waveform 
100i, it signals distributor 102 via control signal 132, 
such that control signal 124 directs shift register 118 
to discharge segment Ti2 (i-i/z) to buffer 122 and 
comparator 116. At the same instant, control signal 
91 toggles switch 94 so that clocking-in via clock line 
15 ceases, and counter 112 begins the count with 
regard to the Ti2 waveform segment. 

Thus, after clock generator 14 operates for 
segment Ti1 (interval "i/z"), it ceases clocking-in of 
the remaining segment Ti2 of waveform 100i. The 
result is that clock generator 14 applies the 
clocking-in operation to store only segment Ti1 of 
waveform portion 1001 during the time interval "i/z n . 
As shift register 1 18 is discharged, the same effect is 
produced with respect to the j and k portions of 
waveform 100, such that the Tj1 and Tk1 segments 
are also stored. The retrieval of stored segment Ti1 
of waveform 100i will be in accordance with the 
frequency transposition technique illustrated in 
Fig. 8G. The' same technique is applied to stored 
segments Tj1 and Tk1 of respective waveform 
portions 100j and k. 

In the above-described controller 84 control 
procedure, during the time shift register 118 is being 
discharged and control signal 91 toggles switch 94 
to control the clocking-in operation on clock line 15, 
shift register 120 is being charged. Since the 
operation of delay line 12 and shift register 120 are 
complementary, control signal 92 simultaneously 
enables switch 96 in continuous fashion such that 
clock line 16 controls retrieval from delay line 12 of 
information stored during the previous periodic 
interval. 

Fig. 10 shows an electronic circuit schematic of a 
frequency analyzer 26 (incorporating a portion of 
Fig. 5 frequency analyzer 26) for use in the 
embodiment of Fig. 7. When a change of a given size 
in the frequency component of audio signal input 13 
is detected by the automatic gain control circuit 
comprising amplifier 136, an IC type MC 4558, and 



unijunction transistor 138, a voltage spike is pro- 
duced at point 140. This voltage spike is then passed 
via amplifiers 141 and 142, IC types ML 397, as 
control signal 87 to controller 84. 
5 It will be appreciated by those skilled in the art that 
frequency analyzer 26 does not provide detection of 
every change in the signal frequency components of 
audio input signal 13. However, by adjustment of 
trimmer resistors 143 and 144, the level of threshold 

10 °L* can be adjusted so that the voltage spike at point 
140 will produce control signal 87 as shown, thereby 
determining the size of the change in frequencies for 
which detection is provided. 
Referring now to Figs. 11A -11G show timing 

15 diagrams of an alternative embodiment of the 
invention based on the embodiment of Fig. 7, 
wherein the functions of controller 84 are replaced 
by a microcontroller, such as a Motorola CMOS type 
MC68HC05. Using waveform 100 of Fig. 8A, the 

20 duration of waveform portions i, j and k is shown in 
Fig. 11 A. These portions are shown as the stored 
segments i/z, j/z, and k/z, as well as the non-stored 
segments I - i/z, j - j/z. and k - k/z. Fig. 11B shows 
the timing of a control signal (equivalent to control 
.25 signal 86) which starts and ends the timing se- 
quence, which has the duration of the periodic 
interval T. Fig. 11C shows the timing of a control 
signal (equivalent to control signal 87) for determin- 
ing that a given size frequency change has occurred. 

30 For the microcontroller embodiment, the compu- 
tations necessary to perform frequency transposi- 
tion are similar to those described in connection with 
Figs. 8A-8G and 9, and the results of these 
computations are stored in a pair of charge and 

35 discharge buffers which are used to control the 
clocking operation performed by clock generator 14 
on delay lines 11 and 12. Fig. 11D shows the 
accumulated input of the charge buffer controlling 
retrieval of Information from one of the delay lines. 

40 This buffer accumulates the timing computed to 
determine the segments i/z, j/z and k/z of waveform 
100 which are to be stored in the next cycle. Fig. 1 1E 
shows the output of this buffer as a control signal 
(equivalent to control signal 92) enabling the clock 

45 line controlling the clocking-out operation of the 
associated one of the delay lines. 

Fig. 11F shows the accumulated timing of the 
discharge buffer determining the segments to be 
stored In the current cycle of the other delay line. 

50 Fig. 11G shows the pulse width modulated timing of 
the discharge buffer described in Fig. 11F, repre- 
senting a control signal (equivalent to control signal 
91) enabling clock line 15 during the clocking-in 
operation. 

55 Fig. 12 shows a flowchart of an algorithm which 
may be used to implement the operation of the 
microcontroller embodiment of Figs. 11 A - 11G. The 
algorithm is interrupt-driven and contains jumps for 
processing of the parameters controlling the timing 

60 sequence. The basic operation begins in block 200 
where the system is reset. The value of transposition 
coefficient z is read in block 202, and in block 204, 
the microcontroller operation continues. 
In block 206, z is checked and the periodic interval 

65 begins per the control signal of Fig. 11B. Switching 
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between charge and discharge buffers is controlled 
by block 208, after which this stage of the process 
ends in block 210. In block 212, z is checked and the 
portions of waveform 100 are calculated in accord- 
ance with the control signal shown In Fig. 1 1 C. Once 5 
computed for the last waveform segment values In 
block 214, these are stored in the charge buffer and 
this stage of the process ends at block 216. 

Control of the pulse width modulated timing of 
Fig. 11G begins in block 218, after which the 10 
previously computed segments of waveform por- 
tions i, j and k are located in block 220 and are fed to 
timers for each of the waveform segments, via 
decision blocks 222, 224 and 226. Control of the 
timers for each of waveform portions i, j and k is 15 
handled by respective timer control blocks 228, 230 
and 232. Each timer presents its information to block 
234 where it is applied to the clock generator and 
then the next waveform portion is triggered via its 
respective decision block and timer control block. 20 
The end of the cycle occurs in block 236, after the 
timing Is repeated by block 234 for each of the 
segments of the input waveform. 

In summary, the inventive hearing aid provides 
frequency transposition for enabling a user to hear 25 
information from a wide range of audio frequencies 
within a narrow band of frequencies in which clinical 
audiometry tests show hearing capability. The 
particular frequency transposition coefficients and 
the corresponding range of frequencies for which 30 
they are used can be adjusted as needed to achieve 
the desired results. Information loss is minimized by 
the use of recirculation, recovery and/or reconstruc- 
tion techniques based on input audio frequency 
signal components. 35 

Having described the invention in connection with 
certain specific embodiments thereof, it is to be 
understood that the description is not meant as a 
limitation since further modifications will now sug- 
gest themselves to those skilled in the art and it is 40 
intended to cover such modifications as fall within 
the scope of the appended claims. 

Claims 45 

1 . Hearing aid apparatus comprising : 
means (11, 12) for converting audio frequency 
soUnds to electrical input signals (13); 
means for storage of information associated 50 
with said electrical input signals (13) ; 
means (26, 14, 84) for controlling the storage 
means (11, 12) to store information at an 
information storage rate and to output the 
stored information waveform at an information 55 
retrieval rate, 

said means (26, 14, 84) for controlling Including 
frequency analyzer means (26) for classifying 
incoming audio frequency sounds as to their 
frequency, and 60 
means responsive to predetermined patient 
hearing characteristics for determining the 
relationship between the information storage 
rate and the information retrieval rate for the 
incoming audio frequency sounds according to 65 



their frequency; and 

means for reproducing audio frequency sounds 
based on the stored information waveform in 
accordance with the information retrieval rate, 
wherein the reproduced audio frequency 
sounds are adapted to a frequency determined 
by a transposition factor (Z) reflecting the 
relationship between the information storage 
and retrieval rates. 

2. Hearing aid apparatus according to claim 1 
and comprising electronic circuitry integrated in 
a hearing aid or transmitting thereto. 

3. Hearing aid apparatus according to either 
of claims 1 and 2 and also comprising means 
(14) for applying information storage and retrie- 
val clocking signals to said storage means (11, 
12). 

4. Hearing aid apparatus according to any of 
the preceding claims and wherein said storage 
means (11, 12) comprises a pair of storage 
devices (11, 12). 

5. Hearing aid apparatus according to claim 4 
and wherein said storage means (11, 12) 
comprises a pair of analog delay lines (11, 12) 
configured in a switched push-pull arrange- 
ment, whereby one delay line (11, 12) stores 
input information at one clock rate while 
Information is retrieved at the output of the 
secondone(12,11)atadifferentrate. . 

6. Hearing aid apparatus according to claim 4 
and wherein said storage means comprises a 
pair of memory devices which receive informa- 
tion at a clocklng-in rate from respective A/D 
converters and feed it to respective D/A 
converters at a clocking-out rate which is 
different. 

7. A hearing aid according to any of the 
preceding claims and also comprising means 
for recirculating information originally stored In 
the storage means (11,12) back to the storage 
means(11, 12), whereby speech components 
containing the same frequency spectrum as 
information lost in prior art embodiments are 
preserved in the output signal (24) . 

8. A hearing aid according to any of the 
preceding claims and wherein said means (26, 
14, 84) for controlling is operative to lower the 
frequencies contained within input speech 
components by using an information retrieval 
rate which is less than the information storage 
rate. 

9. A hearing aid according to any of the 
preceding claims and wherein said means (14, 
26, 84) for controlling is operative to raise the 
frequencies contained within input speech 
components by using an information retrieval 
rate which is greater than the information 
storage rate. 

10. A hearing aid according to any of the 
preceding claims and wherein said means (14, 
26, 84) for controlling also comprises recon- 
struction means for storing portions of the Input 
speech components based on the pattern of 
their frequency spectra and operates based on 
the time interval between sensed changes in 
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the input frequency spectrum. 

11. A hearing aid according to claim 10 and 
wherein said means for controlling (14, 26, 84) is 
operative to store information for only a portion 

of said interval determined by said transposition 5 
factor, whereby only a portion of the information 
enters the storage device (11, 12), and this 
portion contains a group of signal frequency 
components taken from the input speech which 
signal components preserve the pattern of 10 
frequency spectra of the input speech. 

12. A hearing aid according to any of the 
preceding claims 4-11 and also comprising 
approximator means (23) which is operative to 
combine the information waveform from said 15 
pair of storage devices (11, 12) at the time of 
switching in order to smooth the output 
waveform. 

13. A hearing aid according to any of the 
preceding claims and also comprising a noise 20 
generator (25) operative to constantly vary by a 
small amount the transposition factor. 

14. A method of improving hearing of speech 
comprising the steps of: 

converting audio frequency sounds to electrical 25 
input signals; 

storage of an information waveform associated 
with said electrical input signals; 
controlling the storage means to store informa- 
tion at an information storage rate and to output 30 
the stored information at an information retrie- 
val rate, 

classifying incoming audio frequency sounds as 
to their frequency; 

responsive to predetermined patient hearing 35 
characteristics, determining the relationship 
between the information storage rate and the 
information retrieval rate for the incoming audio 
frequency sounds according to their frequency; 
and 40 
reproducing audio frequency sounds based on 
the stored information in accordance with the 
information retrieval rate, wherein the repro- 
duced audio frequency sounds are adapted to a 
frequency determined by a transposition factor 45 
(Z) reflecting the relationship between the 
information storage and retrieval rates. 

15. A method according to claim 14 and also 
comprising the step of recirculating information 
originally stored in the storage means (11, 12) 50 
back to the storage means (11, 12), whereby 
speech components containing the same fre- 
quency spectrum as information lost in prior art 
embodiments are preserved In the output signal 

(24). 55 

16. A method according to claim 14 or claim 15 
and wherein said step of controlling is operative 
to lower the frequencies contained within input 
speech components by using an Information 
retrieval rate which is less than the Information 60 
storage rate. 

17. A method according to claim 14 or claim 15 
and wherein said step of controlling is operative 
to raise the frequencies contained within input 
speech components by using an information 65 



retrieval rate which is greater than the informa- 
tion storage rate. 

18. A method according to any of claims 
14-17 and wherein said step of controlling 
includes the step of reconstruction including 
the step of storing portions of the input speech 
components based on the pattern of their 
frequency spectra and based on the time 
interval between sensed changes in the input 
frequency spectrum. 

19. A method according to any of claims 
14-18 and wherein said step of controlling 
includes the step of storing information for only 
a portion of said interval determined by said 
transposition factor, whereby only a portion of 
the information enters the storage de- 
vice(11,12), and this portion contains a group of 
signal frequency components taken from the 
input speech which signal components 
preserve the pattern of frequency spectra of the 
input speech. 

20. A method according to any of claims 
14-19 wherein said step of storing comprises 
the step of storing in a pair of storage devices 
(11, 12) and also comprising an approximation 
step operative to combine the information 
waveform from said pair of storage devices (11, 
12) at the time of switching in order to smooth 
the output waveform. 

21. A method according to any of claims 
14-20 and also comprising the step of noise 
generation for varying the transposition factor 
by a small amount. 

22. A hearing aid operated in accordance with 
the method of any of claims 14-21. 
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